Hit-and-run for numerical integration 



Daniel Rudolf 



Abstract We study the numerical computation of an expectation of a bounded 
function / with respect to a measure given by a non-normalized density on a con- 
vex body K C W. We assume that the density is log-concave, satisfies a variability 
condition and is not too narrow. In [ 19 25 26] it is required that K is the Euclidean 
unit ball. We consider general convex bodies or even the whole W l and show that 
the integration problem satisfies a refined form of tractability. The main tools are the 
hit-and-run algorithm and an error bound of a multi run Markov chain Monte Carlo 
method. 



1 Introduction and results 

In many applications, for example in Bayesian inference, see or in statistical 

physics, see |[T8ll27l . it is desirable to compute an expectation of the form 



' f(x)K p (dx)= / f(x)cp(x)dx, 

K J K 



where the probability measure n p is given by the density cp with c > 0. The nor- 
malizing constant of the density 

— = f p(x)dx 



c Jk 



is not known and hard to compute. We want to have algorithms that are able to 
compute the expectation without any precompution of c. 
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More precisely, let p:R d — ► R + be a possibly non-normalized density function, 
let K = supp(p ) C M. d be a convex body and let /: K — > R be integrable with respect 
to K p . For a tuple (f,p) we define the desired quantity 

In |fl9ll a simple Monte Carlo method is considered which evaluates the numerator 
and denominater of A(/,p) on a common independent, uniformly distributed sam- 
ple in K. There it must be assumed that one can sample the uniform distribution in 
K. The authors show that this algorithm is not able to use any additional structure, 
such as log-concavity, of the density function. But they show that such structure can 
be used by Markov chain Monte Carlo which then outperforms the simple Monte 
Carlo method. 



Markov chain Monte Carlo algorithms for the integration problem of the form 
fTj) are considered in |[T9l |2T1 [25] |26]. Basically it is always assumed that K is the 
Euclidean unit ball rather than a general convex body. We extend the results to the 
case where K might even be the whole R if the density satisfies some further prop- 
erties. We do not assume that we can sample with respect to K p . The idea is to 
compute A(f,p) by using a Markov chain which approximates n p . We prove that 
the integration problem ([T) satisfies an extended type of tractability. Now let us in- 
troduce the error criterion and the new notion of tractability. 

Error criterion and algorithms. Let t : N x N — > N be a function and let A nAo be 
a generic algorithm which uses t (n,nn) Markov chain steps. Intuitively, the number 
no determines the number of steps to approximate n p . The number n determines the 
number of pieces of information of / used by the algorithm. The error is measured 
in mean square sense, for a tuple (/, p) it is given by 

/ i2\ X /2 

e(A n , no (f,p)) = (E\A n ,„ (f,p)-A{f,p)\ ) , 

where E denotes the expectation with respect to the joint distribution of the used 
sequence of random variables determined by the Markov chain. 

For example the algorithm might be a single or multi run Markov chain Monte 
Carlo. More precisely, assume that we have a Markov chain with limit distribution 
Hp and let X\, . . . ,X n+ „ be the first n + no steps. Then 

H j=l 

is an approximation of A(f,p) and the function t («,«o) = n + no. in contrast to the 
single run Markov chain Monte Carlo S n .n one might consider a multi run Markov 
chain Monte Carlo, say M„.„ Q , given as follows. Assume that we have n independent 
Markov chains with the same transition kernel, the same initial distribution and limit 
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distribution n p . Let X* , . . . ,X" be the sequence of the riQth steps of the Markov 
chains, then 

Mn,n (f,p) = -£f(Xi ) 
is an approximation of A(/,p). In this setting the function t (n,«o) = n ■ no- 

Tractability. In |fl9l |2D a notion of tractability for the integration problem (Q~|i is 
introduced. It is assumed that \\f\\^ < 1 and that the density function satisfies 

mf xeK p(x) 

for some 7 > 3 . Let s e y (n , hq ) be the minimal number of function values of (/, p ) to 
guarantee an e-approximation with respect to the error above. Then the integration 
problem is called tractable with respect to 7 if s £] y(«,«o) depends polylogarithmi- 
cally on 7 and depends polynomially on £ 1 , d. We extend this notion of tractability. 
We study a class of tuples (/, p) which satisfy WfW^ < 1 and we assume that for any 
p there exists a set G C K such that for K > 3 holds 

f K -p(x)6x 

■' KHy ' < K, (2) 



voLi(G) inf vGG p(x) 



where vol c /(G) denotes the af-dimensional volume of G. Then we call the integra- 
tion problem tractable with respect to K if the minimal number of function values 
t E}K (n,no) of (/,p) to guarantee an e-approximation satisfies for some non-negative 
numbers pi, pi and 793 that 

«o) = 0(e- p <d P2 [logK} P3 ), e >0, deN, K>3. 

Hence we permit only polylogarithmical dependence on the number K, since it 
might be very large (e.g. 10 30 or 10 40 ). The extended notion of tractability allows us 
to consider K = supp(p) = W 1 . 



The structure of the work and the main results are as follows. We use the hit- 
and-run algorithm to approximate n p . An explicit estimate of the total variation 
distance of the hit-and-run algorithm, proven by Lovasz and Vempala in lfT31[T6ll . 
and an error bound of the mean square error of M„,„ are essential. In Section|2]we 
provide the basics on Markov chains and prove an error bound of M„,„ . In Section[3] 
we define the class of density functions. Roughly we assume that the densities are 
log-concave, that for any p there exists a set G C K such that condition (|2j holds 
for K > 3 and that the densities are not too narrow. Namely, we assume that level 
sets of p of measure larger than 1 /8 contain a ball with radius r. We distinguish 
two settings which guarantee that the densities are not too spread out. Either the 
convex body K — supp(p) is bounded by a ball with radius R around 0, then we say 
p G ^rjt.K, or the support of p is bounded in average sense, 



\X Xn 



K 
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'7T p (ck) <4R Z , 



where x p = J K xK p (dx) £ Mr" is the centroid. Then we say p g 'fr.Rx- F° r precise 
definitions see Section [3] In Section 0] we provide the hit-and-run algorithm and 
state convergence properties of the algorithm for densities from a tt r ,Rx and %,r, k . 
Then we show that the integration problem ([T) is tractable with respect to K, see 
Section|5] For p £ a i/ r ,R,K we obtain in Theorem[4]that 

te, K (n,no) = ^(^[log^e^pogc-^pogjc] 3 ). (3) 

For p S y r ,R,K we find in Theorem[5]a slightly worse bound of the form 

t e>K {n,n ) = ^(^pog^e^pogc-^pogK] 5 ). (4) 

Here the 6 notation hides the polynomial dependence on r and R. 

In Ifl9l |2T1 [25l |26l it is proven that the problem ([1} is tractable with respect to 7 
for K — Bj, where denotes the Euclidean unit ball. Note that for G = B c [ we have 

J K p(x)dx < snp xeK p(x) < 



vol rf (G) infjgGPW infte^pW 

Furthermore it is assumed that p:B^ — >■ R + is log-concave and logp is Lipschitz. 
Then the Metropolis algorithm with a ball walk proposal is used to approximate n p . 
For 11/11 _ < 1 with p > 2 the algorithm S„,„ Q is considered for the approximation of 
A(f, p). It is proven that 

Se, r (n,no) = ff{dmax{log 2 (y),d}(e- 2 +logy)). (5) 

In open problem 84 of lETl it is asked whether one can extend this result to other 
families of convex sets. The complexity bound of (f5]l is better than the results of 
(O and (HJi in terms of the dimension, the precision and 7. On the one hand the 
assumption that K = Bj is very restrictive but on the other hand the estimates of (0 
and (|4]i seem to be pessimistic. However, with our results we contribute to problem 
84 in the sense that tractability with respect to 7 can be shown for arbitrary convex 
bodies or even the whole W 1 if the density functions satisfy certain properties. 



2 Markov chains and an error bound 

Let (X n ) ne jij be a Markov chain with transition kernel P(-, •) and initial distribution v 
on a measurable space (K, 38{K)), where K C Mr and 3§(K) is the Borel c-algebra. 
We assume that the transition kernel P(-,-) is reversible with respect to n p . For 
p E [1 , °°] we denote by L p = L p (n p ) the class of functions f:K — > R with 
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VP 



\\f\\ P =^j K \m\ p M^)) <°° 

Similarly we denote by ./# p the class of measures V which are absolutely continuous 



dv 

operator P: L p — > L p given by 



with respect to n p and where the density g L p . The transition kernel induces an 



Pf(*)= I f(y)P(x,dy), xeK, 

JK 

and it induces an operator P: ^t p — > ^ p given by 

HP(C)= [ P{x,C)n(dx), Ce3S{K). 



For n e N and a probability measure V note that Pr(X„ G C) = vP"(C), where C € 
£$(K), We define the total variation distance between vP" and 7Tp as 

||vP»-np||^= sup \vP n {C)-n p {C)\. 

Cem(K) 

Under suitable assumptions on the Markov chain one obtains that || vP" — % p || tv — > 
as n — > °°. 

Now we consider the multi run Markov chain Monte Carlo method and prove an 
error bound. This bound is not new, see for example [4 ]. 

Theorem 1. Assume that we have no independent Markov chains with transition 
kernel P(-, •) and initial distribution V € Let % p be a stationary distribution of 
P(-, •). Let XL, . . . ,X£ be the sequence of the n^th steps of the Markov chains and 
let 

1 A 



Mn,no(f,p) = -Zf( X i) 



Then 



e(M n , nQ (f,p)) 2 <-\\f\\l + 2\\f\\i\\vP n -K p \ 



Proof. With an abuse of notation let us denote 

A (/) = / /(*) 7Z P (dx) and vP"° (/) = / /(*) vP"° (dx) . 

JK JK 

We decompose the error into variance and bias. Then 

e(M n . no (f,p)) 2 = -f \f(x)-vP"°(f)\ 2 vP"°(d.x) + \vP"°(f)-A(f)\ 2 
n Jk 

= ~ (vP no (f) - vP"°(f) 2 ) + \vP"°(f)-A(f)\ 2 

< + / /(x) 2 |vP" (dx)-7L,(dbc)| 

n Jk 1 
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<-||/ll- + 2||/|£||W*>-« p|| tv . 

The last inequality follows by a well known characterization of the total variation 
distance, see for example [24 Proposition 3]. 

Very often there exists a number j3 <E [0, 1) and a number C v < °° such that 

\\vP"-n p \\ ty <C v p". 

For example, if j3 = \\P — A\\li^Li < 1 and Cv = \ ||v — 7Tp|| 2 > see [23 1 for more 
details. Let us define the Z^-spectral g a P as 

gap(P) = l-||P-A|| L2 ^ L2 . 

This is a significant quantity, see for instance [2 26 27]|28][29)- In 11261 it is shown 
that 

ngap(f) gap(f) 

There are several Markov chains where it is possible to provide, for certain classes of 
density functions, a lower bound of gap(P) which grows polynomially with respect 
to the dimension, see for example |[T6l[T9l . Then, the error bound of the single run 
Markov chain Monte Carlo method might imply that the integration problem (QJ is 
tractable with respect to some k. 

Note that there are also other possible approximation schemes and other bounds 
of the error of S, hllQ which depend on different assumptions to the Markov chain (e.g. 
Ricci curvature condition, drift condition, small set), see for instance ll^ [TTl[T2l[T3l . 
For example one might consider a multi run Markov chain Monte Carlo method 
where function values of a trajectory of each Markov chain after a sufficiently large 
no are used. But all known error bounds of such methods include quantities such as 
the Z^-spectral gap or the conductance. 

It is not an easy task to prove that a Markov chain satisfies the different assump- 
tions stated above and it is also not an easy task to prove a lower bound of the 
L2-spectral gap. It might be easier to estimate the total variation distance of vP" Q 
and Tip directly. Then one can use Theorem [T] to show that the integration problem 
|TJ is tractable with respect to some fc. 



3 Densities with additional structure 

Let us assume that the densities have some additional structure. For < r < R and 
K > 3 a density function p:K — > M + is in ^ r ,R,K if the following properties are 
satisfied: 
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(a) p is log-concave, i.e. for all x,y € K and X £ [0, 1] one has 

p{Xx+{l-X)y)>p{x) X p{y) l -\ 

(b) p is strictly positive, i.e. K = supp(p) and we assume that K C RB C /, where RB C [ 
is the Euclidean ball with radius R around 0. 

(c) There exists a set G C K such that 

J K p(x)dx <k _ 



vol/(G) mf xeG p(x) 

and we can sample the uniform distribution on G. 
(d) For s > let K(s) = {x G K \ p(x) > t} be the level set of p and let B(z,r) be 
the Euclidean ball with radius r around z. Then 

n p (K(s))>~ =► 3 z e/T fl( z ,r)c«(*). 

The log-concavity of p implies that the maximal value is attained on a convex 
set, that the function is continuous and that one has an isoperimetric inequality, see 
fl6l . Assumption (© gives that K is bounded. 

By (© we can sample the uniform distribution on G. We can choose it as initial 
distribution for a Markov chain, where the number K provides an estimate of the 
influence of this initial distribution. 

The condition on the level set K(s) guarantees that the peak is not too narrow. 
Roughly speaking, if the n p measure of a level set is not too small, then the Lebesgue 
measure is also not too small. Note that K is bounded from below, since condition 
© implies that B(z, r) C K. 

Now we enlarge the class of densities. Let us define the following property: 

(b') p is strictly positive, i.e. K = supp(p) and Xp = f K x n p {Ax) € W 1 is the centroid 



of Tip. Then 



K 



\x — x p \ n p (dx) < 4R 



We have p 6 %,r,k if the density p satisfies ([a]), (|bf ), © and ©. We substituted the 
boundedness condition © by (|bj). Note that (0 implies (Jbf). Hence a i/ r .Rx C %,r,k- 
Condition (|bj) provides a boundedness criterion in average sense. Namely, it implies 
that 

/ ( |x-y| 2 7r p (dx)7r p (dy)<8/? 2 . 
Jkjk 



Example of a Gaussian function in 'f' r ,R, K . Let I be a symmetric and positive 
definite d x d matrix. We consider the non-normalized density 



(p(jc) =exp(--* r IT 1 Ji:), x€M. d . 
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The target distribution is a normal distribution with mean x<p = € K d and 
covariance matrix E. There exists an orthogonal matrix V = (vi,...,V d ), where 
vi, . . . ,v d are the eigenvectors of E. Then 

v -1 2:v = A, 

where A = diag(Ai , . . . , X d ) and Ai , . . . , X d with A; > for i € { 1 , . . . , of} are the 
corresponding eigenvalues of E. Recall that the trace and the determinant of E are 

d d 
tr(Z) = £ A,- and det(Z) = 

We show that if r, R and K are appropriately chosen, then <p e ^,fi,ic- 

To ©: The density <p is obviously log-concave. 
To ((b)): Since = we obtain 

L ' X - ^ = (2^)^/Vdet(£) I |X ' 2 ^ W ^ = tf(Z) ■ 



Hence we set R = A -^/tr(Z). 
To dcj: Let A^n = min, = i ^A, and let v m ; n be the corresponding eigenvector. 
Note that x T E l x < A^ |x| 2 and that equality holds for x = v m ; n . With G = B d 
we obtain 



<p(x)dx 



= «pd A^) T(d/2 + 1) 2 rf / 2 /dit(Z), 



vol d (B d ) M xe B d <p(x) 2 
where r(d) = j$ t d ~ l exp(— t)dt is the gamma function. Hence we set 

K = exp(i A m ') r(d/2 + 1) 2 d l 2 ^(E). 

To ®: The level sets of <p are ellipsoids 

^(i) = {xeR J |x r i:- 1 x<21og(^ 1 )}, s6 [0,1]. 

In general one has 

Jo-vol^^n^))^ .voL ; (^))+f>ol rf (g(Q)df 
^ W; J "vol,(^(f))df £vo\ d (K(t))dt 

By the well known formula of the volume of an ellipsoid we obtain 

vol d (K(t)) = 2 d ' 2 log c/ / 2 (f- Vdet(Z) voL/^,), t e [0, 1] 

and 
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slog^O + J'/log'*/ 2 (t- l )dt 



/ 1 log''/ 2 (f-i)df 



, *e[o,i]. 



Hence 



where y(r,d) — /q t d 1 exp(— t)dt is the lower incomplete gamma function. Let 
us define a function r* : N — > K by 

r*(d)=inf{rG [0,oo) : y ( r ,d/ 2 ) > ir(rf/2)}. 

If we substitute 1 /8 by 1/2 in the definition of r* (d) we have the median of the 
gamma distribution with parameter d/2 and 1. It is known that the median is in 
&(d), see 0"). Figure[T]suggests that r*(d) behaves also linearly in d. 




200 400 600 800 1,000 
dimension d 

Fig. 1 Plot of an approximation of r* (d) with a Newton method and an appropriately chosen initial 
value. 



Let log(**(<i) _1 ) =r*(d), such that s* (d) = exp(-r* (</)). Then 

7C 9 (K(s*(d))) = l and B(0,(X m i n r*(d)) l / 2 )cK(s*(d)). 
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Hence we set r = {X^ m r* {d)) l l 2 . 
Let us summarize. For r = (X^r* {d)) x I 2 , R = 5 y / tr(Z) and 

« = eX P(^ A mm) r(d/2 + 1) 2^ v /deT(Z) 

we obtain that 9 £ ^r,R,K- Note that fc depends exponentially on the dimension a!. 
However, if one has tractability with respect to K, then the error depends polynomi- 
ally on the dimension. 



4 Hit-and-run algorithm 

For p: K — > R + the hit-and-run algorithm is as follows. Let v be a probability mea- 
sure on (K, 3§{K)) and let x\ £ K be chosen by v. For k EN suppose that the states 
X\, . . . ,JC4 are already computed. Then 

1. choose a direction u uniformly distributed on dB c f, 

2. set Xk+i = Xk + a u, where a e 4 = {a e R | jcjt + au £ K} is chosen with 
respect to the distribution determined by the density 

£ k {s) = r . , s€/ t . 

The second step might cause implementation issues. However, if we have a log- 
concave density p then is also log-concave. In this setting one can use different 
acceptance/rejection methods. For more details see for example |6, Section 2.4.2] 
or ifPTl . In the following we assume that we can sample the distribution determined 
by 4- 

Other algorithms for the approximation of n p would be a Metropolis algorithm 
with suitable proposal [ 19] or a combination of a hit-and-run algorithm with uniform 
stationary distribution and a Ratio-of-uniforms method iflOll . Also hybrid samplers 
are promising methods, especially when p decreases exponentially in the tails Q- 

Now let us state the transition kernel, say H p , of the hit-and-run algorithm 

h p(x,C) = : 2 n ,, [ P(y)dy . . , X£K,C£MK), 



where 



£p(x,y) = j p{Xx+{\-X)y)\ K (Xx+(\-X)y)dX. 



The transition kernel H p is reversible with respect to n p , let us refer to [3 1 for further 
details. 
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In the following we state several results from Lovasz and Vempala. This part is 
based on |fl31 . We start with a special case of [ 1 5 Theorem 1.1] and sketch the proof 
of this theorem. 

Theorem 2. Let e € (0, 1 /2) and p £ W r ,R,K- Let V be an initial distribution with the 
following property. There exists a set S E C K and a number D > 1 such that 



dv 
dn 



(x)<D, x£K\S e , 



where v(S £ ) < £. Then for 

n > l0 27 {dr~ 1 R) 2 \og l (SDdr~ 1 Re~ 1 )\og(4De~ 1 ) 
the total variation distance between vHp° and Tip is less than 2e. 
Proof (Sketch). 



1 . Let us assume that S £ = 0: 



Then it follows 



dv 



dun 



s = ID anc ' obtain 



< D, so that v £ Jioo. We use 1 14 Corollary 1.6] with 



vh;-tz p 



< e/2+Dexp(--n<P 2 e ), 
tv~ ' 2 



where <J>^ is the -conductance of Hp. By Theorem 3.7 of ifTSI and the scaling 
invariance of the hit-and-run algorithm we find a lower bound of <P e . It is given 
by 



-13 



This leads to 



vh; - k p 



tv 



10 

<t> g > 

td - 2 dr~ x R\og(Adr- x RD £~ l 

< e/2+Dexp 



lQ- 26 n 



8 [dr- 1 R) 2 log 2 (4 d r - 1 R D e - 1 ) 



(6) 



(7) 



2. Now let us assume that S £ ^ 0: 

Let e := v(S e ), so that < e < e < 1/2 and for C £ 3${K) let 

v(cnsg) , ,„ s v(cns £ ) 

Ml(0= T^FT 1 and MC)- 



V(S £ ) 



Then 



and 



dm 



d% 



v = (l-e)/x,i + e/i 2 
< 2D. Furthermore for any C £ SS(K) we find 

vH" (C) Tip (C) < (1 - e) Mi^p" (C) - 7T P (C) 
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By using (|7]) we get 



HiHp~Kp ^ < e/2 + 2Dexp 



-l(r 26 n 



8 1 R) 2 log 2 (8 dr" 1 RD e 1 ) 



and altogether 



vh;-k p 



tv 



< 3e/2 + 2Dexp 



-l(T 26 n 



%{dr- 1 R) 2 \og 2 {%dr- 1 RDe 



(8) 



Choosing n so that the right hand side of the previous equation is less than or 
equal to 2e completes the proof. 

The next Corollary provides an explicit upper bound of the total variation distance. 

Corollary 1. Under the assumptions of Theorem\2\with 

-10- 9 



j3 = exp 



{dr- l R)V 3 



and C=l2dr l RD 



one obtains 



\vH' p 10 ~ Kp\\ w <C/3^, »gN. 



Proof. Set e = 8 dr l RDexp 1^2/3 ) and use © t0 complete the proof. 

Note that the result of Theorem[2]is better than the result of Corollary Q] However, 
Corollary [Uprovides an explicit estimate of the total variation distance. One can see 
that there is an almost exponential decay, namely the total variation distance goes to 
zero at least as j3 v 7 "" goes to zero for increasing no- 

In the previous results we assumed that p E °i/ r ,R,K- It is essentially used that 
© holds. Now let us assume that p 6 %,r,k- The next statement is proven in lfT31 
Theorem 1.1]. 

Theorem 3. Let e G (0, 1 /2), p € ^r,k- Let v be an initial distribution with the 
following property. There exists a set S £ C K and a number D > 1 such that 



dv 
dK n 



(x)<D, xeK\S e , 



where v(S E ) < £. Then for 

« > 4 • 10 30 \dr~ 1 R) 2 log 2 {2Ddr- l R£- 1 ) log 3 (D e 1 ) 
the total variation distance between vHp° and K p is less than 2e. 

Note that Theorem [2] and Theorem [3] can be applied if the initial distribution 



is bounded, i.e. we can set D 



dv 

dKn 



and S £ = 0. Furthermore if V G i.e. 
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dv 



dKp 

dv 



d%n 



is bounded, then we can also apply Theorem [2] and Theorem [3] with D 

2 
2 

£ _1 and 



dv 



diZp 



V 1 



5 Main results 

Now we are able to state and to prove the main results. To avoid any pathologies we 
assume that r~ l Rd > 3. 

Theorem 4. Let e E (0, 1 /2) and 

&rfi,K = {(f,p)\pe%R,K, ll/IL<i}. 

For (f,p) G ^r.R.K let V be the uniform distribution on G C Mr from (|cp. Let 
X* ,.. . ,X„ Q be a sequence of the n^th steps of n independent hit-and-run Markov 
chains with stationary distribution 7t p and initial distribution V. Recall that 

Mn,n (f,p) = -tf( X i)- 
n j=l 

Then for n > £~ 2 and 

«o > 1 27 {df X R) 2 log 2 (8 dr" 1 R k e ~ 2 ) log (4 k e ~ 2 ) 

we obtain 

sup e(M„.„ (f,p)) < 3e. 

(/,p)e^i, t 

Hence 

t e , K (n,n ) = 0{d 2 {r- 1 R) 2 log 2 (dr- l R)e- 2 [logg- 1 ] 3 [log k] 3 ). 
Proof For C e 3§(K) we have 



c vol d (G)p(y) 



v(c)=/ /,ir^rr.r ^(dy). 



It implies that j^{x) < K for all Then the assertion follows by Theorem Q] 

and Theorem|2] 

Now let us consider densities which belong to %b k . 

Theorem 5. Let e e (0, 1 /2) and 
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%fi,K={{f,p)\p£%fi,K, ||/L<1}. 

Let M„„ be given as in Theorem^ Then for n > £T 2 and 

«o > 4 • 1 30 (dr- 1 R) 2 log 2 (2 dr~ 1 R K e " 2 ) log 3 ( k £ ~ 2 ) 

we obtain 

sup e(M„.„ (/,p)) < 3e. 

(f,p)e%ji, K 

Hence 

t e , K (n,n ) = 0{d 2 (r- l R) 2 log 2 {dr- l R)e- 2 [logg- 1 ] 5 [log k} 5 ). 

Proof. The assertion follows by the same steps as the proof of Theorem|4] Note that 
we use Theorem|3]instead of Theorem|2] 

Note that in both theorems there is no hidden dependence on further parameters 
in the 6 notation. However, the explicit constant might be very large, of the mag- 
nitude of 10 30 . The theorems imply that the problem of integration ([T) is tractable 
with respect to K on the classes ^ r ,R.K and %,r, k . 

Example of a Gaussian function revisited. In the Gaussian example of Section[3] 
we obtained 

R/r=(2r*(d) 1 / 2 )- l -y/tx(L)/X mhi , 

* = ex P(^ + 1) 2<*/ 2 /de<£). 

If we assume that r* (d) increases linearly in d (Figure Q}, that \/tr(Z)/A m i n and 
log(exp(5 ^ m i n )\/ det(Z)) grows polynomially in the dimension, then t £X (n,no) 
grows also polynomially in the dimension. This implies that the integration problem 
with respect to the Gaussian function is polynomially tractable in the sense of Novak 
and Wozniakowski l20ll2Tll22l. 
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